System and method for appliance control via a network

ABSTRACT

A first remote control application is configured to cause a smart device to transmit at least one command for controlling at least one functional operation of a controllable appliance in response to a user interface element of the smart device being activated while a second remote control application of a bridge device is configured to cause the bridge device to transmit at least one command for controlling at least one functional operation of the controllable appliance in response to receiving at the bridge device the at least one command transmitted from the smart device. The at least one command is transmitted from the smart device using a first transmission protocol and the at least one command is transmitted from the bridge device using a transmission protocol recognized by the controllable appliance.

RELATED APPLICATION INFORMATION

This application claims the benefit of and is a continuation of U.S.application Ser. No. 16/106,831, filed on Aug. 21, 2018, whichapplication claims the benefit of and is a continuation of U.S.application Ser. No. 14/736,909, filed on Jun. 11, 2015, whichapplication claims the benefit of and is a continuation of U.S.application Ser. No. 13/328,416, filed on Dec. 16, 2011, whichapplication claims the benefit of and is a continuation-in-part of U.S.patent application Ser. No. 13/071,661, filed Mar. 25, 2011.

The disclosures within these applications are incorporated herein byreference in their entirety.

BACKGROUND

Controlling devices, for example remote controls, for use in issuingcommands to entertainment and other appliances, and the features andfunctionality provided by such controlling devices are well known in theart and have become ubiquitous in the home. Wireless networktechnologies such as WiFi, Bluetooth, etc., are increasing deployed inhomes in support of personal communication, productivity, andentertainment devices such as tablet computers, smart phones, portableemail devices, e-books, hand-held games and/or game controllers,portable media players, etc. (all referred to hereafter as “smartdevices”).

SUMMARY

This invention relates generally to controlling devices such as remotecontrols, and more specifically to controlling devices which incorporatewireless networking capability. In an exemplary embodiment, acontrolling device may be provisioned with a wireless network interfacesuch as a WiFi transceiver and associated programming in addition toconventional IR and/or RF transmitters and/or transceivers for issuingappliance commands. This wireless network interface may be used toreceive and relay appliance command requests from other devices presenton the network, for example smart phones, tablet or desktop computers,or if enabled, even distant devices via a wide area network such as theInternet. Further, in some embodiments the controlling device, forexample a universal remote control, may utilize such a wirelessnetworking capability to communicate with local appliances or Internetbased services to facilitate setup and configuration of the controllingdevice, for appliance identification purposes, etc.

A better understanding of the objects, advantages, features, propertiesand relationships of the invention will be obtained from the followingdetailed description and accompanying drawings which set forthillustrative embodiments and which are indicative of the various ways inwhich the principles of the invention may be employed.

BRIEF DESCRIPTION OF THE DRAWINGS

For a better understanding of the various aspects of the invention,reference may be had to preferred embodiments shown in the attacheddrawings in which:

FIG. 1 illustrates an exemplary system in which a controlling deviceconstructed in accordance with the instant invention may be utilized;

FIG. 2 illustrates in block diagram form components of the exemplarycontrolling device of FIG. 1;

FIGS. 3 and 4 further illustrate systems in which an exemplarycontrolling device constructed in accordance with the invention may beutilized;

FIG. 5 illustrates an exemplary operational flow as may be implementedin configuring a smart device to utilize features of the controllingdevice of FIGS. 1 and 4; and

FIG. 6 illustrates an exemplary operational flow as may be implementedto cause a user-requested appliance command to be issued in accordancewith this invention.

DETAILED DESCRIPTION

With reference to FIG. 1, there is illustrated an exemplary system inwhich a controlling device 100 is configured to control variouscontrollable appliances, such as a television 102, an AV receiver 104and a set top box (“STB”) 106. As is known in the art, the controllingdevice 100 may be capable of transmitting commands to the appliances,using any convenient IR, RF, Point-to-Point, or networked protocol 122,to cause the appliances to perform operational functions. Whileillustrated in the context of a television 102, AV receiver 104, and STB106, it is to be understood that controllable appliances may include,but need not be limited to, televisions, VCRs, DVRs, DVD players, cableor satellite converter set-top boxes (“STBs”), amplifiers, CD players,game consoles, home lighting, drapery, fans, HVAC systems, thermostats,personal computers, etc. Controlling device 100 may be further adaptedto support a wireless communication interface 126 to a local network,for example a home WiFi network enabled by a router and wireless accesspoint 112. Exemplary other devices with wireless access to the networkmay include a smart phone 108, a tablet computer 110, and STB 106.Router 112 may also offer wired access 114 to the local network, forexample supporting a desktop computer 116. Access to a wide area network120 such as the Internet may be available through router 112 and networkgateway device 118 such as a cable modem, DSL service, etc. In someembodiments, certain appliances may be digitally interconnected, forexample via HDMI interface cables 124. It will be appreciated thatalthough the illustrative WiFi network of FIG. 1 is depicted asoperating in the so-called “WiFi infrastructure mode”, i.e., with alldevices communicating through a common central switching means (e.g.,router 112), in many applications certain WiFi-enabled devices may alsobe adapted to communicate directly with one another on a point-to-pointbasis using the so-called “WiFi direct” or “ad hoc networking” mode ofoperation. Accordingly, in the further illustrations that follow WiFilinks between devices may be depicted for simplicity in the form ofdirect paths with the understanding that any available WiFi operationalmode may be used without limitation, as appropriate for a particularembodiment.

With reference to FIG. 2, for use in commanding the functionaloperations of one or more appliances, the controlling device 100 mayinclude, as needed for a particular application, a processor 200 coupledto a ROM memory 204, a non-volatile read/write memory 206, a RAM memory205, a key matrix 216 (e.g., hard keys, soft keys such as a touchsensitive surface overlaid on a liquid crystal (LCD), and/or anelectroluminescent (EL) display), transmission circuit(s) and/ortransceiver circuit(s) 210 (e.g., IR and/or RF) for use in issuingcommands to controlled appliances, a means 202 to provide feedback tothe user (e.g., one or more LEDs, illuminable keys, display, speaker,and/or the like), an input/output port 218 such as a serial interface,USB port, modem, etc., a power source 220 such as a battery, and clockand timer logic 212 with associated crystal or resonator 214, a localnetwork interface and transceiver 222 such as for example an IEEE 802.11“WiFi” interface, and in certain embodiments a low power timing device224 which may be incorporated into processor 200, for example in theform of a nanopower ring oscillator as may be found in the MAXQ610microprocessor available from Maxim Integrated Products Inc., may formpart of local network interface 222, or may comprise a separatecomponent.

As will be understood by those skilled in the art, some or all of thememories 204, 205, 206 may include executable instructions(collectively, the controlling device program memory) that are intendedto be executed by the processor 200 to control the operation of thecontrolling device 100, as well as data which serves to define thenecessary control protocols and command values for use in transmittingcommand signals to controllable appliances (collectively, the commanddata). In this manner, the processor 200 may be programmed to controlthe various electronic components within the controlling device 100,e.g., to monitor the key matrix 216 and/or network interface 222, tocause the transmission of signals, etc. The non-volatile read/writememory 206, for example an EEPROM, battery-backed up RAM, FLASH, SmartCard, memory stick, or the like, may additionally be provided to storesetup data and parameters as necessary. While the memory 204 isillustrated and described as a ROM memory, memory 204 can also becomprised of any type of readable media, such as ROM, FLASH, EEPROM, orthe like. Preferably, the memories 204 and 206 are non-volatile orbattery-backed such that data is not required to be reloaded afterbattery changes. In addition, the non-transitory memories 204, 205 and206 may take the form of a chip, a hard disk, a magnetic disk, anoptical disk, and/or the like. Still further, it will be appreciatedthat some or all of the illustrated memory devices may be physicallycombined (for example, a single FLASH memory may be logicallypartitioned into different portions to support the functionality ofmemories 204 and 206 respectively), and/or may be physicallyincorporated within the same IC chip as the microprocessor 200 (a socalled “microcontroller”) and, as such, they are shown separately inFIG. 2 only for the sake of clarity.

To cause the controlling device 100 to perform an action, thecontrolling device 100 is adapted to be responsive to events, such as asensed user interaction with the key matrix 216, receipt of a networktransmission, etc. In response to an event, appropriate instructionswithin the program memory (hereafter the “controlling device operatingprogram”) may be executed. For example, when a command function key isactuated on the controlling device 100, the controlling device 100 mayretrieve from the command data stored in memory 204, 205, 206 a commandvalue and control protocol corresponding to the actuated function keyand, where necessary, current device mode and transmit that command toan intended target appliance, e.g., STB 106, in a format recognizable bythat appliance to thereby control one or more functional operations ofthat appliance. It will be appreciated that the controlling deviceoperating program can be used not only to cause the transmission ofcommands and/or data to the appliances, but also to perform localoperations. While not limiting, local operations that may be performedby the controlling device 100 may include displaying information/data,favorite channel setup, macro key setup, function key relocation, etc.Examples of local operations can be found in U.S. Pat. Nos. 5,481,256,5,959,751, and 6,014,092. Additionally, in the instant invention thecontrolling device operating program of exemplary controlling device 100may be operative to send and receive messages via local networktransceiver 222 as will be disclosed in greater detail hereafter. Incertain embodiments the controlling device operating program may utilizelow power timer 224 to periodically wake processor 200 from a quiescentstate in order to monitor transceiver 222 for incoming messages, forbattery conservation purposes as are known in the art.

In some embodiments, controlling device 100 may be of the universaltype, that is provisioned with a library comprising a multiplicity ofcommand codes and protocols, i.e., command data, suitable forcontrolling various appliances. In such cases, for selecting sets ofcommand data to be associated with the specific appliances to becontrolled (hereafter referred to as a setup procedure), data may beentered into the controlling device 100 that serves to identify eachintended target appliance by its make, and/or model, and/or type. Suchdata allows the controlling device 100 to identify the appropriatecommand data set within the library of command data that is to be usedto transmit recognizable commands in formats appropriate for suchidentified appliances. The library of command data may represent aplurality of controllable appliances of different types and manufacture,a plurality of controllable appliances of the same type but differentmanufacture, a plurality of appliances of the same manufacture butdifferent type or model, etc., or any combination thereof as appropriatefor a given embodiment. In conventional practice as is well known in theart, such data used to identify an appropriate command data set may takethe form of a numeric setup code entered via activation of those keysthat are also used to cause the transmission of commands to an appliance(obtained, for example, from a printed list of manufacturer names and/ormodels with corresponding code numbers, from a support Web site, etc.).Alternative setup procedures known or proposed in the art includescanning bar codes, sequentially transmitting a predetermined command indifferent formats until a target appliance response is detected, userinteraction with a Web site culminating in downloading of command dataand/or setup codes to the controlling device, etc. Since such methodsfor setting up a controlling device to command the operation of specifichome appliances are well-known, these will not be described in greaterdetail herein. Nevertheless, for additional information pertaining tosetup procedures, the reader may turn, for example, to U.S. Pat. No.4,959,810, 5,614,906, or 6,225,938, all of like assignee andincorporated herein by reference in their entirety.

In yet further alternative setup procedures, in certain embodiments acontrolling device with WiFi or other local network connectivity mayutilize this connectivity to facilitate the identification of intendedtarget appliances and their associated command data sets. As illustratedin FIG. 3, exemplary controlling device 100 may communicate directly 302with an appliance, for example STB 106, in order to execute aninteractive setup procedure as described in U.S. Pat. No. 7,969,514, orto download appliance identification data stored in the memory ofappliance 106 or derived from other appliances which share an HDMIinterconnection 124 such as TV 102 or AV receiver 104, for example asdescribed in co-pending U.S. patent application Ser. No. 12/716,365,entitled “Digital Interconnect of Entertainment Equipment in the Home,”Ser. No. 13/240,604 entitled “System and Method for ConfiguringControlling Device Functionality,” Ser. No. 13/198,072 entitled “Systemand Method for Configuring the Remote Control Functionality of aPortable Device,” all of common ownership and all incorporated herein byreference in their entirety, or in the before mentioned Ser. No.12/148,444 entitled “Using HDMI-CEC to Identify a Codeset,” of whichthis application is a continuation-in-part. Once the desired appliancehas been identified, an appropriate command data set may be selectedfrom a library of command data sets preloaded in the memory ofcontrolling device 100; or may be downloaded into controlling device 100from a library of command data sets stored on a local appliance, forexample STB 106, or on a network accessible server 130. In the event thecommand data set library is located on a Web server 130, the requisitedata set may be provisioned to a WiFi enabled controlling device 100either by direct interaction 304 with the Internet 120, or via anintermediate appliance such as STB 106, as appropriate for a particularembodiment.

With reference to FIG. 4, once so configured an exemplary controllingdevice 100, in addition to its conventional functionality, may beadapted to make itself available as a bridge or relay device to issueappliance commands 402 in response to requests 404 received via awireless local network from, for example, a remote control app residentin a smart device 108, as will now be described in further detail.

Turning now to the flowchart of FIG. 5, after installation on a smartdevice such as 108 of FIG. 4 a remote control app may be placed into asetup mode at step 502. The setup mode may be initiated for example byuser activation of a “setup” icon, automatically upon initialinstallation, etc., as appropriate. Once in the setup mode, at steps 504and 506 the remote control app may determine, via additional user inputfor example, whether the setup mode was invoked to configure a newlocation or to select an existing location. By way of explanation, insome embodiments a remote control app may be capable of supportingmultiple appliance configurations and multiple associatednetwork-enabled controlling devices, corresponding for example to livingroom/bedroom locations, town home/vacation home locations, etc. As willbe appreciated step 504 may be omitted, for example if no location iscurrently configured or in those embodiments in which only a singlelocation configuration is supported, etc. If neither of these operationsis indicated, at step 522 other setup operations appropriate to aparticular app may be performed, for example and without limitationprogramming of activity macros (to the extent these are not alreadyavailable through controlling device 100), entry of favorite channelinformation, setting of parental controls, etc.

If it is determined at step 506 that a new location is to be configured,at step 508 the app resident in smart device 108 may initiate discoveryof other devices present on the local wireless network, and inparticular devices which identify themselves as compatible command relayplatforms. If no such devices are found an appropriate error report iscommunicated to the user at step 524, whereupon the app may exit setupmode. If, however, compatible command relay device(s) are found, at step512 the app and a relay device may be paired, i.e., numeric oralphanumeric codes, key values, hardware addresses, serial numbers, etc.may be exchanged between the app and the relay device (sometimesrequiring user interaction such as entering a numeric value presented ona display, printed on a label, etc.) in order that they may uniquelyrecognize transmissions from one another in the future. In the eventmore than one compatible relay device was located at step 508, step 512may also include soliciting input from a user to select a particularcommand relay device. This pairing step may also comprise user provisionof a location name or other identifier by which this particular commandrelay device and its associated appliances may be identified in thefuture. In suitably equipped smart devices this step may also includethe association of GPS coordinates with the stored configuration. If itis determined at step 514 that pairing could not be successfullycompleted, an error message is displayed as before and the app exitssetup mode.

Once paired, at step 516 the smart device app may use thenow-established communication path to request appliance configurationinformation from controlling device 100. Such information may comprise,for example one or more of the number and types of appliances currentlyconfigured in controlling device 100; the identities of the command codedata sets currently in use by controlling device 100 for issuingcommands to target appliances; the configured appliance identificationdata such as brand or model numbers, etc. Such information may be usedby the smart device app at step 518 to retrieve information for use inconfiguring GUI pages, for example listings of supported commands,display icons, etc., which may be downloaded from a Web server 130. Inan alternate embodiment, information regarding which specific commandfunctions are supported by each of the appliances may be provideddirectly by controlling device 100 in place of, or in addition to, theWeb downloaded data. In a yet further alternate embodiment, an identityassociated with the controlling device 100 itself may be utilized eitherin place of or in conjunction with the previously described methods. Forexample, in cases where controlling device 100 was provided as originalequipment together with a target appliance, e.g. AV receiver 104, a MACaddress, serial number, or other identifying data procured fromcontrolling device 100 may be referred to a web service 130 whereat adatabase cross-referencing controlling device MAC addresses, serialnumbers, etc., to the specific appliances with which they were shippedmay be utilized to exactly identify a target appliance, e.g. AV receiver104, and its corresponding features and command code set. At step 520this information may then be used to configure the smart device app GUIto match the appliances to be controlled, for example by removal ofunsupported functions or addition of supported functions in touch screendisplay pages, incorporation of appliance or brand specific icons orlogos, etc. As will be appreciated, in certain small footprintembodiments of a remote control app, such GUI customization may beforgone in favor of a standardized default GUI which may present onlyfrequently used command functions which are common to a majority ofappliance brands and models. Once any such GUI customization isconcluded, setup is complete and the app may exit the setup mode orconduct any further location dependent configuration steps, for examplecommunicating with controlling device 100 or STB 106 to downloadfavorite channel settings applicable to the current location.

Returning to step 504, if it is determined that the setup mode wasinitiated in order to change the currently assigned location, at step526 the user may be requested to select a location to be configured, forexample from a displayed list of location identities previously suppliedby the user(s) at step(s) 512. Alternatively, in suitably equipped smartdevices the current GPS coordinates may be compared to those previouslyassociated with the presently selected location and locationreconfiguration automatically trigged if these coordinates differ by asignificant amount, e.g., by more than a room size for room locations orby a house/yard size for house locations. Regardless, at step 530 it isthen determined if the relay device associated with that location is infact present in the current environment, i.e., is discoverable. If not,at step 532 an appropriate error message is displayed and the app exitssetup mode. If the relay device is confirmed as present, at step 534 itmay next be determined if the command relay device remains paired. Byway of explanation, in some embodiments a controlling device which isalso operable as a command relay device may be adapted to cancel or voidits pairing information if the controlled appliances are reconfigured,for example an appliance is deleted or replaced, a new appliance isadded, etc. In such cases, step 534 may cause the smart device app tocontinue at step 516, thereby reconfiguring the app to conform to thenew appliance configuration. If however no changes have been made andthe relay device remains paired, then processing may continue at step520 which may configure the app GUI to match the selected location.

Once configured, an exemplary smart device remote control app may beoperative to cause appliance commands to be issued as will now bedescribed in conjunction with FIG. 6. When invoked at step 602, thesmart device remote control app may load and present a GUI at step 604,e.g., display a set of icons representing touch-activated commandfunctions comprising one or more pages, which GUI may have beenconfigured and associated with the current location of the smart deviceas described previously. At step 610 the exemplary smart device remotecontrol app may then await user input such as actuation of a touch icon,a hard key, a gesture or motion, etc. Upon receipt of user input, atstep 612 it may then be determined if the input comprises an appliancecommand request. If not, at steps 606 and 608 other input functions maybe processed, for example app termination and exit, display ofadditional pages of command icons, etc.

If it is determined that the received input comprises a request for anappliance command, at step 614 the requested function is encoded using astandardized set of generic function indicators and appliance typeindicators which are compatible with the controlling device operatingprogram of an associated relay device, e.g., controlling device 100 ofthe instant example. In this regard, any convenient set of standardfunction and appliance type indicators which is supported by bothrequesting and receiving devices may be utilized as appropriate for aparticular embodiment. For reference and without limitation, examples ofsuch sets of standardized indicators may be found in U.S. patentapplication Ser. No. 11/088,694 or 12/716,365, both of common ownershipand incorporated herein by reference in their entirety. Thereafter atstep 616 a request comprising the standard function indicatorinformation may be communicated via the local network to relay device100.

Upon receipt of such a request at step 620, at step 622 the controllingdevice operating program of a command relay device such as the exemplarycontrolling device 100 may retrieve from codeset data stored in memory204,205,206 the command value and control protocol information whichcorresponds to the requested appliance and function. Thereafter at step624 this retrieved information may be employed to transmit a commandsignal which will cause the designated appliance to perform the desiredoperation.

While various concepts have been described in detail, it will beappreciated by those skilled in the art that various modifications andalternatives to those concepts could be developed in light of theoverall teachings of the disclosure. For example, while presented abovein the form of an illustrative embodiment in which a WiFi enabledcontrolling device interacts with an app resident in a smart device, itwill be appreciated that the methods described herein may be utilized inconjunction with any suitable local network technology, e.g., Bluetooth,Zigbee, Zwave, etc., and may serve to provide appliance controlfunctionality to apps and/or other software programming resident in manydifferent types of devices, e.g. smart devices, PCs, game consoles, homeautomation systems, etc., local or remote.

Further, while described in the context of functional modules andillustrated using block diagram format, it is to be understood that,unless otherwise stated to the contrary, one or more of the describedfunctions and/or features may be integrated in a single physical deviceand/or a software module, or one or more functions and/or features maybe implemented in separate physical devices or software modules. It willalso be appreciated that a detailed discussion of the actualimplementation of each module is not necessary for an enablingunderstanding of the invention. Rather, the actual implementation ofsuch modules would be well within the routine skill of an engineer,given the disclosure herein of the attributes, functionality, andinter-relationship of the various functional modules in the system.Therefore, a person skilled in the art, applying ordinary skill, will beable to practice the invention set forth in the claims without undueexperimentation. It will be additionally appreciated that the particularconcepts disclosed are meant to be illustrative only and not limiting asto the scope of the invention which is to be given the full breadth ofthe appended claims and any equivalents thereof.

All patents cited within this document are hereby incorporated byreference in their entirety.

What is claimed is:
 1. A non-transitory, computer readable media havinginstructions stored thereon wherein the instructions, when executed by asmart device, cause the smart device to perform steps comprising:receiving from a bridge device data indicative of a one or more commandcode sets the bridge device is configured to use in transmitting one ormore commands to control one or more functional operations of a one ormore controllable appliances in communication with the bridge device;using the data indicative of the one or more command code sets toretrieve a graphical user interface (GUI) definition; and using theretrieved GUI definition to create a GUI page for display in a displayof the smart device, the GUI page presenting in the display of the smartdevice at least a plurality of user input elements which, whenactivated, will cause the smart device to transmit a communication tothe bridge device to, in turn, cause the bridge device to transmit oneor more commands from the one or more command code sets to control oneor more functional operations of the one or more controllable appliancesin communication with the bridge device.
 2. The non-transitory, computerreadable media as recited in claim 1, wherein the data indicative of theone or more command code sets comprises data indicative of a uniqueidentifier provided to the bridge device.
 3. The non-transitory,computer readable media as recited in claim 2, wherein the dataindicative of a unique identifier provided to the bridge devicecomprises data indicative of a MAC address provided to the bridgedevice.
 4. The non-transitory, computer readable media as recited inclaim 1, wherein the data indicative of the one or more command codesets comprises a command code set identifier for each of the one or morecommand code sets.
 5. The non-transitory, computer readable media asrecited in claim 1, wherein the retrieved GUI definition is used tocreate a GUI page which includes user input elements that matchfunctional operations supported by the one or more controllableappliances and which excludes user input elements that do no matchfunctional operations supported by the one or more controllableappliances.
 6. The non-transitory, computer readable media as recited inclaim 1, wherein the instructions further cause the smart device toretrieve from the bridge device the data indicative of the one or morecommand code sets.
 7. The non-transitory, computer readable media asrecited in claim 1, wherein the instructions further cause the smartdevice to use generic function indicators and appliance type indicatorsrecognizable by the bridge device when transmitting commands forcontrolling the at least one functional operation of one or morecontrollable appliances.
 8. The non-transitory, computer readable mediaas recited in claim 1, wherein the instructions cause the smart deviceto be automatically configured with the GUI page in direct response tothe smart device being paired with the bridge device.